Collective Media Annotation using Random Field Models
نویسنده
چکیده
We present methods for semantic annotation of multimedia data. The goal is to detect semantic attributes (also referred to as concepts) in clips of video via analysis of a single keyframe or set of frames. The proposed methods integrate high performance discriminative single concept detectors in a random field model for collective multiple concept detection. Furthermore, we describe a generic framework for semantic media classification capable of capturing arbitrary complex dependencies between the semantic concepts. Finally, we present initial experimental results comparing the proposed approach to existing methods.
منابع مشابه
Collective Annotation of Music from Multiple Semantic Categories
Music semantic annotation aims to automatically annotate a music signal with a set of semantic labels (words or tags). Existing methods on music semantic annotation usually take it as a multi-label binary classification problem, and model each semantic label individually while ignoring their relationships. However, there are usually strong correlations between some labels. Intuitively, investig...
متن کاملSemantic-Based Image Retrial in the VQ Compressed Domain using Image Annotation Statistical Models
متن کامل
NER for Medical Entities in Twitter using Sequence to Sequence Neural Networks
Social media sites such as Twitter are attractive sources of information due to their combination of accessibility, timeliness and large data volumes. Identification of medical entities in Twitter can support tasks such public health surveillance. We propose an approach to perform annotation of medical entities using a sequence to sequence neural network. Results show that our approach improves...
متن کاملImage and Audio Annotation: Approximate Inference in Dense Conditional Random Fields
In the task of image and audio annotation, it is typical for labels to be assigned independently. While some correlations may be modeled, it is rare for all interdependencies between labels to be considered. This is because exact inference on a dense, cyclical graphical model is often intractable. This paper applies an approximate inference method, log-determinant relaxation (LDR), to a fully c...
متن کاملCollective Transport in Random Media: From Superconductors to Earthquakes
In these lectures, a variety of non-equilibrium transport phenomena are introduced that all involve, in some way, elastic manifolds being driven through random media. A simple class of models is studied focussing on the behavior near to the critical “depinning” force above which persistent motion occurs in these systems. A simple mean field theory and a “toy” model of “avalanche” processes are ...
متن کامل